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Introduction to Linux 


Linux is an operating system, like macOS or Windows. 


It is also the most popular Open Source and free, as in freedom, operating 


system. 


It powers the vast majority of the servers that compose the Internet. It's the 
base upon which everything is built upon. But not just that. Android is based 


on (a modified version of) Linux. 


The Linux "core" (called kernel) was born in 1991 in Finland, and it went a 
really long way from its humble beginnings. It went on to be the kernel of the 
GNU Operating System, creating the duo GNU/Linux. 


There's one thing about Linux that corporations like Microsoft and Apple, or 
Google, will never be able to offer: the freedom to do whatever you want with 


your computer. 


They're actually going in the opposite direction, building walled gardens, 
especially on the mobile side. 


Linux is the ultimate freedom. 


It is developed by volunteers, some paid by companies that rely on it, some 
independently, but there's no single commercial company that can dictate 
what goes into Linux, or the project priorities. 


Linux can also be used as your day to day computer. I use macOS because I 
really enjoy the applications, the design and I also used to be an iOS and Mac 
apps developer, but before using it I used Linux as my main computer 
Operating System. 


No one can dictate which apps you can run, or "call home" with apps that 
track you, your position, and more. 


Linux is also special because there's not just "one Linux", like it happens on 
Windows or macOS. Instead, we have distributions. 


A "distro" is made by a company or organization and packages the Linux core 
with additional programs and tooling. 


For example you have Debian, Red Hat, and Ubuntu, probably the most 
popular. 


Many, many more exist. You can create your own distribution, too. But most 
likely you'll use a popular one, one that has lots of users and a community of 
people around it, so you can do what you need to do without losing too much 


time reinventing the wheel and figuring out answers to common problems. 


Some desktop computers and laptops ship with Linux preinstalled. Or you 
can install it on your Windows-based computer, or on a Mac. 


But you don't need to disrupt your existing computer just to get an idea of 


how Linux works. 
I don't have a Linux computer. 


If you use a Mac you need to know that under the hood macOS is a UNIX 
Operating System, and it shares a lot of the same ideas and software that a 
GNU/Linux system uses, because GNU/Linux is a free alternative to UNIX. 


UNIX is an umbrella term that groups many operating systems used in 


big corporations and institutions, starting from the 70's 


The macOS terminal gives you access to the same exact commands I'll 
describe in the rest of this handbook. 


Microsoft has an official Windows Subsystem for Linux which you can (and 
should!) install on Windows. This will give you the ability to run Linux in a 
very easy way on your PC. 


But the vast majority of the time you will run a Linux computer in the cloud 
via a VPS (Virtual Private Server) like DigitalOcean. 


A shell is a command interpreter that exposes to the user an interface to work 
with the underlying operating system. 


It allows you to execute operations using text and commands, and it provides 
users advanced features like being able to create scripts. 


This is important: shells let you perform things in a more optimized way than 
a GUI (Graphical User Interface) could ever possibly let you do. Command 
line tools can offer many different configuration options without being too 


complex to use. 


There are many different kind of shells. This post focuses on Unix shells, the 
ones that you will find commonly on Linux and macOS computers. 


Many different kind of shells were created for those systems over time, and a 
few of them dominate the space: Bash, Csh, Zsh, Fish and many more! 


All shells originate from the Bourne Shell, called sn . "Bourne" because its 


creator was Steve Bourne. 


Bash means Bourne-again shell. s» was proprietary and not open source, 
and Bash was created in 1989 to create a free alternative for the GNU project 
and the Free Software Foundation. Since projects had to pay to use the 
Bourne shell, Bash became very popular. 


If you use a Mac, try opening your Mac terminal. That by default is running 
ZSH. (or, pre-Catalina, Bash) 


You can set up your system to run any kind of shell, for example I use the 
Fish shell. 


Each single shell has its own unique features and advanced usage, but they 
all share a common functionality: they can let you execute programs, and 
they can be programmed. 


In the rest of this handbook we'll see in detail the most common commands 
you will use. 


2. Man 


The first command I want to introduce is a command that will help you 
understand all the other commands. 


Every time I don't know how to use a command, I type man <commana> to get 
the manual: 


ee Applications — man /Users/flavio/Applications — less < man Is 
LS(1) BSD General Commands Manual 


NAME 
ls -—- list directory contents 


SYNOPSIS 
ls [-ABCFGHLOPRSTUW@abcdefghikLmnopqrstuwxl1%] [file ...] 

DESCRIPTION 
For each operand that names a file of a type other than directory, 
ls displays its name as well as any requested, associated informa- 
tion. For each operand that names a file of type directory, ls dis- 
plays the names of files contained within that directory, as well as 
any requested, associated information. 


If no operands are given, the contents of the current directory are 
displayed. If more than one operand is given, non-directory oper- 
ands are displayed first; directory and non-directory operands are 
sorted separately and in lexicographical order. 


The following options are available: 


-@ Display extended attribute keys and sizes in long (-L) out- 
put. 


(The numeric digit ``one''.) Force output to be one entry 


This is a man (from manual) page. Man pages are an essential tool to learn, 
as a developer. They contain so much information that sometimes it's almost 
too much. 


The above screenshot is just 1 of 14 screens of explanation for the is 
command. 


Most of the times when I'm in need to learn a command quickly I use this site 
called tldr pages: hitps://tidr.sh/. It's a command you can install, then you 
run it like this: tiar <command> , which gives you a very quick overview of a 


command, with some handy examples of common usage scenarios: 


ee 
+ ~ tldr ls 


ls 
List directory contents. 


- List files one per line: 
ls -1 


- List all files, including hidden files: 
ls -a 


- Long format list (permissions, ownership, size and modification date) of all 
files: 
ls -la 


- Long format list with size displayed using human readable units (KB, MB, GB) 


ls -lh 


- Long format list sorted by size (descending): 
ls -1S 


- Long format list of all files, sorted by modification date (oldest first): 
ls -ltr 


This is not a substitute for man , but a handy tool to avoid losing yourself in 
the huge amount of information present in a man page. Then you can use the 
man page to explore all the different options and parameters you can use on 
a command. 


2. ls 


Inside a folder you can list all the files that the folder contains using the 1s 
command: 


If you add a folder name or path, it will print that folder contents: 


ls /bin 


fi flaviocopes — fish /Users/flaviocopes — -fish — 72x9 


ed launchctl mv tcsh 
expr link pax test 
hostname ln psl unlink 


kill ls pwd wait4path 
ksh mkdir rm zsh 


1s accepts a lot of options. One of my favorite options combinations is - 
alp Try it: 


ls -al /bin 


ee fi flaviocopes — fish /Users/flaviocopes — -fish — 72x20 
~ ls -al /bin 
total 5120 
drwxr-xr-x@ 37 root wheel 1184 Feb 
drwxr-xr-x 30 root wheel 960 Feb 
-rwxr-xr-X root wheel 22704 Jan 
-r-Xr-xr-X root wheel 618416 Jan 
-rwxr-xr-X root wheel 23648 Jan 
-rwxr-Xr-X root wheel 34144 Jan 
-rwxr-Xr-X root wheel 29024 Jan 
-rwxr-xr-X root wheel 379952 Jan 
-rwxr-xr-X root wheel 28608 Jan 
-rwxr-xr-X root wheel 32000 Jan 
-rwxr-Xr-X root wheel 23392 Jan 
-rwxr-xXr-X root wheel 18128 Jan 
-rwxr-xXr-xX root wheel 54080 Jan 
-rwxr-Xr-X root wheel 23104 Jan 
-Ywxr-xXr-X root wheel 18288 Jan = hostname 
-rwxr-xXr-X root wheel 18688 Jan : kill 
-r-xr-xr-x root wheel 1282864 Jan : ksh 
-rwxr-xr-X root wheel 121296 Jan : launchctl 


m 


Es a (SS Ss a sess esses 


compared to the plain is , this returns much more information. 
You have, from left to right: 


e the file permissions (and if your system supports ACLs, you get an ACL 
flag as well) 


+ the number of links to that file 
e the owner of the file 

e the group of the file 

e the file size in bytes 

e the file modified datetime 

+ the file name 


This set of data is generated by the 1 option. The a option instead also 
shows the hidden files. 


Hidden files are files that start with a dot ( . ). 


4. cd 


Once you have a folder, you can move into it using the ca command. ca 
means change directory. You invoke it specifying a folder to move into. You 
can specify a folder name, or an entire path. 


Example: 


mkdir fruits 


CORE AURES 
Now you are into the fruits folder. 
You can use the .. special path to indicate the parent folder: 


ed me i 


The # character indicates the start of the comment, which lasts for the entire 
line after it's found. 


You can use it to form a path: 


meas Executes 
mda “Cars 
(fel TEIeULIES} 


Cae cans 


There is another special path indicator which is . , and indicates the 
current folder. 


You can also use absolute paths, which start from the root folder / : 


eel fice 


This command works on Linux, macOS, WSL, and anywhere you have a 
UNIX environment 


5. pwd 


Whenever you feel lost in the filesystem, call the pwa command to know 
where you are: 


pwd 


It will print the current folder path. 


6. mkdir 


You create folders using the mkdir command: 


mkdir fruits 


You can create multiple folders with one command: 


mkdir dogs cars 


You can also create multiple nested folders by adding the -p option: 


mkdir -p fruits/apples 


Options in UNIX commands commonly take this form. You add them right 
after the command name, and they change how the command behaves. You 
can often combine multiple options, too. 


You can find which options a command supports by typing man 
<commandname> . Try now with man mkdir for example (press the q key to esc 
the man page). Man pages are the amazing built-in help for UNIX. 


7. rmdir 


Just as you can create a folder using mkair , you can delete a folder using 


emGlists . 


mkarr ErUTES 


rmdir fruits 


You can also delete multiple folders at once: 


inl <obLies aziablibicisy cexslia's} 


BMS EOE S ETES 


The folder you delete must be empty. 


To delete folders with files in them, we'll use the more generic rm command 
which deletes files and folders, using the -rf options: 


ici) a eebe Ceg 


Be careful as this command does not ask for confirmation and it will 
immediately remove anything you ask it to remove. 


There is no bin when removing files from the command line, and recovering 
lost files can be hard. 


8. mv 


Once you have a file, you can move it around using the mv command. You 
specify the file current path, and its new path: 


touch pear 


mv pear new pear 


The pear file is now moved to new pear . This is how you rename files and 
folders. 


If the last parameter is a folder, the file located at the first parameter path is 
going to be moved into that folder. In this case, you can specify a list of files 
and they will all be moved in the folder path identified by the last parameter: 


touch pear 
touch apple 
mkdir fruits 


mv pear apple fruits 


9. Cp 
You can copy a file using the cp command: 


Ouch mEes tr 
cp apple another apple 


To copy folders you need to add the -r option to recursively copy the whole 
folder contents: 


mikGdasise ser Usntes: 


Cle is abiablabics) ene 


10. open 
The open command lets you open a file using this syntax: 


open <filename> 


You can also open a directory, which on macOS opens the Finder app with 


the current directory open: 


open <directory name> 


I use it all the time to open the current directory: 


open . 


The special . symbol points to the current directory, as .. points to 


the parent directory 


The same command can also be be used to run an application: 


open <application name> 


11. touch 
You can create an empty file using the touch command: 


touch apple 


If the file already exists, it opens the file in write mode, and the timestamp of 
the file is updated. 


12. find 


The fina command can be used to find files or folders matching a particular 
search pattern. It searches recursively. 


Let's learn it by example. 


Find all the files under the current tree that have the .js extension and 
print the relative path of each file matching: 


AEL a MANS VE 


It's important to use quotes around special characters like ~* to avoid the 
shell interpreting them. 


Find directories under the current tree matching the name "src": 
find . -type d -name src 
Use -type £ to search only files, or -type 1 to only search symbolic links. 


-name is case sensitive. use -iname to perform a case-insensitive search. 


You can search under multiple root trees: 


find folderl folder2 -name filename.txt 


Find directories under the current tree matching the name "node_modules" 
or ‘public’: 


Pind Cype cd name node modules eri name public 


You can also exclude a path, using -not -path : 


ieabael type Cl oome Ye cimtcl” evens pea Tode modules am" 


You can search files that have more than 100 characters (bytes) in them: 


find . -type £ -size +100c 
Search files bigger than 100KB but smaller than 1MB: 


IEALIQNG! o Seya GE -Size FLOOR -S176 -1M 


Search files edited more than 3 days ago 
find . -type £ -mtime +3 
Search files edited in the last 24 hours 


tind. type f meiimen l 


You can delete all the files matching a search by adding the -delete option. 
This deletes all the files edited in the last 24 hours: 


find . -type f -mtime -1 -delete 


You can execute a command on each result of the search. In this example we 
run cat to print the file content: 


find . -type f -exec cat {} \; 


notice the terminating \; . {} is filled with the file name at execution time. 


13. In 


The in command is part of the Linux file system commands. 


It's used to create links. What is a link? It's like a pointer to another file. A file 
that points to another file. You might be familiar with Windows shortcuts. 
They're similar. 


We have 2 types of links: hard links and soft links. 


Hard links are rarely used. They have a few limitations: you can't link to 
directories, and you can't link to external filesystems (disks). 


A hard link is created using 


ln soriginedl> <iLauiqules 


For example, say you have a file called recipes.txt. You can create a hard link 
to it using: 


ln recipes.txt newrecipes.txt 


The new hard link you created is indistinguishable from a regular file: 


- fish /Users/flavio — -fish — 63x10 


f flav 
~ ls -al newrecipes.txt 
-rw-r--r-- 1 flavio staff 8 Sep 2 11:25 newrecipes.txt 


Now any time you edit any of those files, the content will be updated for both. 


If you delete the original file, the link will still contain the original file 
content, as that's not removed until there is one hard link pointing to it. 


fish /Users/flavio 49x9 


fi flavio “HSI 
~ Ln recipes.txt newrecipes.txt 
- cat newrecipes.txt 
recipes 


- rm recipes.txt 


~ cat newrecipes.txt 
recipes 


~ 


Soft links are different. They are more powerful as you can link to other 
filesystems and to directories, but when the original is removed, the link will 
be broken. 


You create soft links using the -s option of in : 


la =g <orteimel> <ibaligier 


For example, say you have a file called recipes.txt. You can create a soft link 
to it using: 


ln -s recipes.txt newrecipes.txt 


In this case you can see there's a special ı flag when you list the file using 
1s -al , and the file name has a e at the end, and it's colored differently if 


you have colors enabled: 


fi flav fis Jsers/flavic 
~ Ls -al newrecipes.txt 
Llrwxr-xr-x 1 flavio staff 11 Sep 2 11:26 @ -> recipes.txt 


Now if you delete the original file, the links will be broken, and the shell will 
tell you "No such file or directory" if you try to access it: 


Úi flavio — fish /Users/flavio — -fist 
~ Ln -s recipes.txt newrecipes.txt 
- cat newrecipes.txt 
recipes 
~ rm recipes.txt 
~ cat newrecipes.txt 


cat: newrecipes.txt: No such file or directory 


14. gzip 


You can compress a file using the gzip compression protocol named L277 


using the gzip command. 


Here's the simplest usage: 


gzip filename 


This will compress the file, and append a .gz extension to it. The original 
file is deleted. To prevent this, you can use the -c option and use output 


redirection to write the output to the filename.gz file: 


gzip -c filename > filename.gz 


The -c option specifies that output will go to the standard output 


stream, leaving the original file intact 


Or you can use the -x option: 


gzip -k filename 


There are various levels of compression. The more the compression, the 
longer it will take to compress (and decompress). Levels range from 1 
(fastest, worst compression) to 9 (slowest, better compression), and the 
default is 6. 


You can choose a specific level with the -<wumszr> option: 


gzip -1 filename 


You can compress multiple files by listing them: 


gzip filenamel filename2 


You can compress all the files in a directory, recursively, using the -r 
option: 


Giano ie! fel rOl 


The -v option prints the compression percentage information. Here's an 
example of it being used along with the -x (keep) option: 


fi flavio — fish /Users/flavio - 


~ gzip -kv wget-log 
wget-Log: 49.7% -- replaced with wget-log.gz 


~ 


gzip can also be used to decompress a file, using the -a option: 


gzip -d filename.gz 


15. gunzip 


The gunzip command is basically equivalent to the gzip command, except 


the -a option is always enabled by default. 


The command can be invoked in this way: 


gunzip filename.gz 


This will gunzip and will remove the .gz extension, putting the result in the 
filename file. If that file exists, it will overwrite that. 


You can extract to a different filename using output redirection using the -c 


option: 


gunzip -c filename.gz > anotherfilename 


16. tar 


The tar command is used to create an archive, grouping multiple files in a 


single file. 


Its name comes from the past and means tape archive. Back when archives 
were stored on tapes. 


This command creates an archive named archive.tar with the content of 


filel and file2: 


pari e ElineloskyS. tele Seal rai? 


The c option stands for create. The £ option is used to write to file 


the archive. 


To extract files from an archive in the current folder, use: 


tario Blinc. tenes 


the x option stands for extract 


and to extract them to a specific directory, use: 


tar -xf archive.tar -C directory 


You can also just list the files contained in an archive: 


fi flavio — fish /Users/flavio — -fish — 55x5 
tar -tf archive.tar 
file1 


file2 


tar is often used to create a compressed archive, gzipping the archive. 


This is done using the z option: 


eke -OAE EuaClulys. wee cos Eel eZ 


This is just like creating a tar archive, and then running gzip onit. 


To unarchive a gzipped archive, you can use gunzip , OF gzip -a , and then 
unarchive it, but tar -x will recognize it's a gzipped archive, and do it for 
you: 


(ENE SIE ElreGIMal AS). ENE CIMA 


17. alias 


It's common to always run a program with a set of options you like using. 


For example, take the 1s command. By default it prints very little 


information: 


bash-3.2$ ls 
words.txt 
bash-3.2$ 


while using the -a1 option it will print something more useful, including 
the file modification date, the size, the owner, and the permissions, also 
listing hidden files (files starting witha . : 


bash-3.2$ ls 

words.txt 

bash-3.2$ ls -al 

total @ 

drwxr-xr-x 3 flavio staff 96 Sep 3 15:20. 


drwxr-xr-x+ 55 flavio staff 1760 Sep 3 15:20 .. 
-rw-r--r-- 1 flavio staff @ Sep 3 15:20 words.txt 
bash-3.2$ 


You can create a new command, for example I like to call it 11 , that is an 
alias to 1s -a1 . 


You do it in this way: 


alras lI=!]ls aT! 


Once you do, you can call 11 just like it was a regular UNIX command: 


bash-3.2$ alias ll='ls -al' 
bash-3.2$ 

bash-3.2$ 11 

total @ 


drwxr-xr-x 3 flavio staff 96 Sep 3 15:20 . 
drwxr-xr-x+ 55 flavio staff 1760 Sep 3 15:20 .. 
-rw-r--r-- 1 flavio staff @ Sep 3 15:20 words.txt 
bash-3.2$ J 


Now calling alias without any option will list the aliases defined: 


bash-3.2$ alias 
alias ll='ls -al' 


bash-3.2$ 


The alias will work until the terminal session is closed. 


To make it permanent, you need to add it to the shell configuration, which 
could be ~/.bashre OF ~/.profile OF  ~/.bash profile If you use the Bash 
shell, depending on the use case. 


Be careful with quotes if you have variables in the command: using double 
quotes the variable is resolved at definition time, using single quotes it's 
resolved at invocation time. Those 2 are different: 


lias lsthis="l1s $PWD" 


w 


lias lscurrent='ls S$PWD' 


w 


$PWD refers to the current folder the shell is into. If you now navigate away 
to a new folder, iscurrent lists the files in the new folder, isthis still lists 
the files in the folder you were when you defined the alias. 


18. cat 


Similar to tail in some way, we have cat . Except cat can also add 


content to a file, and this makes it super powerful. 


In its simplest usage, cat prints a file's content to the standard output: 


CGE ise 


You can print the content of multiple files: 


Cere arkel seat ike? 


and using the output redirection operator > you can concatenate the 
content of multiple files into a new file: 


Gene arn IKSak Sealey > SS 


Using >> you can append the content of multiple files into a new file, 
creating it if it does not exist: 


cat scale sealikeyn Se seal dlSs} 


When watching source code files it's great to see the line numbers, and you 
can have cat print them using the -n option: 


carine e 


You can only add a number to non-blank lines using -» , or you can also 
remove all the multiple empty lines using -s . 


cat is often used in combination with the pipe operator | to feed a file 


content as input to another command: cat filel | anothercommand . 


19. less 


The iess command is one I use a lot. It shows you the content stored inside 


a file, in a nice and interactive UI. 


Usage: less <filename> . 


bash-scripting — less /Users/flaviocopes/www/flaviocopes.com/content/post/cli/bash-scripting — less index.md — 72x... 


B 


title: "Introduction to Bash Shell Scripting" 

date: 2019-01-15T07:00:00+02:00 

description: "A detailed overview to scripting the Bash Shell" 
tags: cli 


Shell scripting is an powerful way to automate tasks that you regularly 
execute on your computer. 


In this tutorial I give an extensive overview of shell scripting, and wi 
ll be the base reference for more in-depth and advanced tutorials on cre 
ating practical shell scripts. 


> Check out my [introduction to Bash](/bash/) post. 


Bash gives you a set of commands that put together can be used to create 
Little programs, that by convention we call scripts. 


Note the difference. We don't say Bash programming but Bash scripting, a 
nd we don't call Bash scripts "Bash programs". This is because you can g 


Once you are inside a iess session, you can quit by pressing q. 


You can navigate the file contents using the up and down keys, or using the 
space bar and » to navigate page by page. You can also jump to the end of 
the file pressing c and jump back to the start pressing g . 


You can search contents inside the file by pressing / and typing a word to 
search. This searches forward. You can search backwards using the >? 
symbol and typing a word. 


This command just visualises the file's content. You can directly open an 
editor by pressing v . It will use the system editor, which in most cases is 


vim. 


Pressing the r key enters follow mode, or watch mode. When the file is 
changed by someone else, like from another program, you get to see the 
changes live. By default this is not happening, and you only see the file 
version at the time you opened it. You need to press ctri-c to quit this 
mode. In this case the behaviour is similar to running the tail -f 


<filename> command. 


You can open multiple files, and navigate through them using :n (to go to 
the next file) and :p (to go to the previous). 


20. tail 


The best use case of tail in my opinion is when called with the -£ option. It 
opens the file at the end, and watches for file changes. Any time there is new 
content in the file, it is printed in the window. This is great for watching log 
files, for example: 


tail -f£ /var/log/system.log 


To exit, press ctri-c. 


You can print the last 10 lines in a file: 


canl ne LO <e lenem 


You can print the whole file content starting from a specific line using + 
before the line number: 


weni =i PO <<araikeioemney> 


tail can do much more and as always my advice is to check man tail . 


21. WC 


The wc command gives us useful information about a file or input it 
receives via pipes. 


echo test >> test.txt 
We le sie ENE 
il i 5 PASEO EKE 


Example via pipes, we can count the output of running the is -al 


command: 


6 47 284 


The first column returned is the number of lines. The second is the number 
of words. The third is the number of bytes. 


We can tell it to just count the lines: 


We: ally ESSE ee 


or just the words: 


WC iW) ECSib al xe 


or just the bytes: 


Mic —C WSC Ieee 


Bytes in ASCII charsets equate to characters, but with non-ASCII charsets, 
the number of characters might differ because some characters might take 
multiple bytes, for example this happens in Unicode. 


In this case the -m flag will help getting the correct value: 


WC Mt CES text 


22. grep 


The grep command is a very useful tool, that when you master will help you 
tremendously in your day to day. 


If you're wondering, grep stands for global regular expression print 


You can use grep to search in files, or combine it with pipes to filter the 
output of another command. 


For example here's how we can find the occurences of the 


document.getElementById line inthe index.ma file: 


grep document.getElementById index.md 


flavio — bash /Users/flavio — bash — 77x 
bash-3.2$ grep document.getElementById index.md 
document .getELementById('button').addEventListener('click', © => { 
document .getELementById('button').addEventListener('click', © => { 


bash-3.2$ 


Using the -n option it will show the line numbers: 


grep -n document.getElementById index.md 


bash-3.2$ grep -n document.getELementById index.md 
60: document ..getELementById('button').addEventListener('click', O => { 
128: document.getELementById('button').addEventListener('click', © => { 


bash-3.2$ 


One very useful thing is to tell grep to print 2 lines before, and 2 lines after 
the matched line, to give us more context. That's done using the -c option, 
which accepts a number of lines: 


grep -nC 2 document.getElementById index.md 


ee flavio — bash /U avio — — 76x16 
bash-3.2$ grep -nC 2 document.getElementById index.md 
58- 
59-***js 
60: document .getELementById('button').addEventListener('click', O => { 
61- //item clicked 
62-}) 


126-***js 

127-window.addEventListener('load', O => { 

128: document.getElementById('button').addEventListener('click', O => { 
129- setTimeout(() => { 

130- items.forEachCitem => { 

bash-3.2$ 


Search is case sensitive by default. Use the -i flag to make it insensitive. 


As mentioned, you can use grep to filter the output of another command. We 
can replicate the same functionality as above using: 


less index.md | grep -n document.getElementBylId 


ee flav bash /Users/flav ast 7x7 
bash-3.2$ less index.md | grep -n document .getElementById 
60:document .getElementById('button').addEventListener('click', O => { 
128: document.getElementById('button').addEventListener('click', © => { 


bash-3.2$ 


The search string can be a regular expression, and this makes grep very 
powerful. 


Another thing you might find very useful is to invert the result, excluding the 
lines that match a particular string, using the -v option: 


oe 

bash-3.2$ ls -al 

total 120 

drwxr-xr-x 4 flavio staff 128 3 08:15 . 
drwxr-xr-x 138 flavio staff 4416 22 14:58 .. 
-rw-r--r-- 1 flavio staff 49556 3 09:37 banner.png 
-rw-r--r-- 1 flavio staff 5659 11 2020 index.md 


bash-3.2$ ls -al | grep -v index.md 

total 120 

drwxr-xr-x 4 flavio staff 128 3 08:15 . 
drwxr-xr-x 138 flavio staff 4416 22 14:58 .. 
-rw-r--r-- 1 flavio staff 49556 3 09:37 banner.png 
bash-3.2$ fj 


23. sort 


Suppose you have a text file which contains the names of dogs: 


O © 
Roger 
Syd 
Vanille 
Luna 
Ivica 


Tina 


This list is unordered. 


The sort command helps us sorting them by name: 


ee aV 
>» ~ sort dogs.txt 
Ivica 
Luna 


Roger 
Syd 


Tina 
Vanille 


-> ~ 


Use the r option to reverse the order: 


o o fi flavio fish / 
> ~ sort -r dogs.txt 
Vanille 
Tina 
Syd 


Roger 
Luna 
Ivica 


> ~l 


Sorting by default is case sensitive, and alphabetic. Use the --ignore-case 
option to sort case insensitive, and the -n option to sort using a numeric 
order. 


If the file contains duplicate lines: 


o o flavio nano /Users/flavi nano dogs.txt 


GNU nano 2.0.6 File: dogs.txt Modified 


We Get Heli) WriteOu Read Fij Prev Pa Cut Tex@f@ Cur Pos 
wi Exit 8) Justif Where IÑ} Next Pai UnCut To Spel 


You can use the -u option to remove them: 


> ~ sort -u dogs.txt 
Ivica 
Luna 
Roger 


Syd 
Tina 
Vanille 


-> ~ 


sort does not just works on files, as many UNIX commands it also works 
with pipes, so you can use on the output of another command, for example 
you can order the files returned by ıs with: 


ls || S@icic 


sort 1s very powerful and has lots more options, which you can explore 
calling man sort. 


ee 
SORT(1) BSD General Commands Manual SORT(1) 


NAME 
sort -- sort or merge records (lines) of text and binary files 


SYNOPSIS 
sort [-bcCdfghiRMmnrsuVz] [-k fiel J] [-S memsize] [-T dir] [-t char] [-o output 
fila cl 
sort --help 
sort --version 


DESCRIPTION 
The sort utility sorts text and binary files by lines. A line is a record separated from the sub- 
sequent record by a newline (default) or NUL '\@' character (-z option). A record can contain any 
printable or unprintable characters. Comparisons are based on one or more sort keys extracted 
from each line of input, and are performed lexicographically, according to the current locale's 
collating rules and the specified command-line options that can tune the actual sorting behavior. 
By default, if keys are not given, sort uses entire lines for comparison. 


The command line options are as follows: 


-c, --check, -C, --check=silentlquiet 
Check that the single input file is sorted. If the file is not sorted, sort produces the 
appropriate error messages and exits with code 1, otherwise returns @. If -C or 
--check=silent is specified, sort produces no output. This is a "silent" version of -c. 


--merge 
Merge only. The input files are assumed to be pre-sorted. If they are not sorted the 
output order is undefined. 


output, --output=output 
Print the output to the output file instead of the standard output. 


size, --buffer-size=size 
Use size for the maximum size of the memory buffer. Size modifiers %,b,K,M,G,T,P,E,Z,Y 
can be used. If a memory limit is not explicitly specified, sort takes up to about 90% of 
available memory. If the file size is too big to fit into the memory buffer, the tempo- 
rary disk files are used to perform the sorting. 


--temporary-directory=dir 
Store temporary files in the directory dir. The default path is the value of the environ- 
ment variable TMPDIR or /var/tmp if TMPDIR is not defined. 


-u, --unique 
Unique keys. Suppress all lines that have a key that is equal to an already processed 
one. This option, similarly to -s, implies a stable sort. If used with -c or -C, sort 
also checks that there are no lines with duplicate keys. 


Stable sort. This option maintains the original record order of records that have an 
equal key. This is a non-standard feature, but it is widely accepted and used. 


--version 
Print the version and silently exits. 


24. uniq 


unig is a command useful to sort lines of text. 


You can get those lines from a file, or using pipes from the output of another 
command: 


ibbgake; “<Clevers! Gee 

le | una, 
You need to consider this key thing: unig will only detect adjacent duplicate 
lines. 


This implies that you will most likely use it along with sort : 


Sort Cose wse || Wholake; 


The sort command has its own way to remove duplicates with the -u 
(unique) option. But uniq has more power. 


By default it removes duplicate lines: 


fi flavio — fish /Users/flavio 
- cat dogs.txt 
Roger 
Syd 
Vanille 
Luna 
Ivica 
Tina 
Roger 
Syd 
~ sort dogs.txt | unig 
Ivica 
Luna 
Roger 
Syd 
Tina 
Vanille 


You can tell it to only display duplicate lines, for example, with the -a 


option: 


Bionic clogs imc || Wicks: —cl 


@ flavio — fish /Users/flavio — -fish 
cat dogs.tx 
Roger 
Syd 
Vanille 
Luna 
Ivica 
Tina 
Roger 
Syd 


sort dogs.txt | unig -d 
Roger 
Syd 


You can use the -u option to only display non-duplicate lines: 


fi flavio — fish /Users/flavio — -fish 
cat dogs.txt 
Roger 
Syd 
Vanille 
Luna 
Ivica 
Tina 
Roger 
Syd 


sort dogs.txt | unig -u 
Ivica 


Luna 
Tina 
Vanille 


You can count the occurrences of each line with the -c option: 


fi flavio — fish /Users/flavio 
- cat dogs.txt 
Roger 
Syd 
Vanille 
Luna 
Ivica 
Tina 
Roger 


Syd 


- sort dogs.txt | unig -c 
Ivica 
Luna 
Roger 
Syd 
Tina 
Vanille 


Use the special combination: 


sorgt Cogas exe || Mine =e || Semie -mi 


to then sort those lines by most frequent: 


Éi flavio — fish /Users/flavio — -fish — 44x8 
sort dogs.txt | uniq -c | sort -nr 
Syd 
Roger 
Vanille 


Tina 
Luna 
Ivica 


25. diff 


diff is a handy command. Suppose you have 2 files, which contain almost 
the same information, but you can't find the difference between the two. 


diff will process the files and will tell you what's the difference. 


Suppose you have 2 files: dogs.txt and moredogs.txt . The difference is that 


moredogs.txt contains one more dog name: 


oo 

cat dogs.txt 
Roger 
Syd 

cat moredogs.txt 


Roger 
Syd 
Vanille 


diff dogs.txt moredogs.txt Will tell you the second file has one more line, 


line 3 with the line vanilie : 


| o fi flavio — fish /Users/flavio — -fish 


~ diff dogs.txt moredogs.txt 
2a3 


> Vanille 


~ 


If you invert the order of the files, it will tell you that the second file is 


missing line 3, whose content is vanille : 


ee fi flavio — fish /Users/flavio — -fish - 
~ diff moredogs.txt dogs.txt 
3d2 
< Vanille 


~ 


Using the -y option will compare the 2 files line by line: 


eo i flavio 
~ diff -y dogs.txt moredogs.tx 
Roger Roger 
Syd Syd 
> Vanille 


~i 


The -u option however will be more familiar to you, because that's the same 
used by the Git version control system to display differences between 


versions: 


ee fi flavio — fish /Users/flavio 

~ diff -u dogs.txt moredogs.txt 
--- dogs.txt 2020-09-07 08:54:56.000000000 +0200 
+++ moredogs.txt 2020-09-07 08:55:09.000000000 +0200 
@@ -1,2 +1,3 @ 


Roger 
Syd 
+Vanille 


~ 


Comparing directories works in the same way. You must use the -r option 
to compare recursively (going into subdirectories): 


e o E testing — fish /Users/flavio/testing — -fish — 68x13 
+ testing ls 
dogs .txt 
> testing ls 
dogs.txt 
> testing diff -u dir1 dir2 
diff -u diri/dogs.txt Pey txt 


--- dir1/dogs.txt 2020-09-07 08:54:56.000000000 +0200 
+++ dir2/dogs.txt 2020-09-07 08:55:09.000000000 +0200 
@@ -1,2 +1,3 @ 
Roger 
Syd 
+Vanille 
testing 


In case you're interested in which files differ, rather than the content, use the 


r and q options: 


ee E testing — fish /U 
testing diff -rq diri dir2 


Js 


Files diri/dogs.txt and dir2/dogs.txt differ 


testing Jj 


There are many more options you can explore in the man page running man 


liber 


fla an /\ fla 


User Commands DIFF(1) 


diff - compare files line by line 


SYNOPSIS 
diff [OPTION]... FILES 


DESCRIPTION 
Compare files line by line. 


-i --ignore-case 
Ignore case differences in file contents. 


--ignore-file-name-case 
Ignore case when comparing file names. 


--no-ignore-file-name-case 
Consider case when comparing file names. 


--ignore-tab-expansion 
gnore changes due to tab expansion. 


--ignore-space-change 
Ignore changes in the amount of white space. 


--ignore-all-space 
Ignore all white space. 


--ignore-blank-lines 
Ignore changes whose lines are all blank. 


-I RE --ignore-matching-lines=RE 
Ignore changes whose lines all match RE. 


--strip-trailing-cr 
Strip trailing carriage return on input. 


--text 
Treat all files as text. 


-C NUM --context[=NUM 
Output NUM (default 3) lines of copied context. 


-U NUM --unified[=NUM 
Output NUM (default 3) lines of unified context. 


--label LABEL 
Use LABEL instead of file name. 


-p --show-c-function 
Show wh C function each change is in. 


-F RE --show-function-Line=RE 


26. echo 


The echo command does one simple job: it prints to the output the 


argument passed to it. 


This example: 
echo "hello" 


will print ne110 to the terminal. 


We can append the output to a file: 


Grelaye; Wlaevbile = OMETE a exc 


We can interpolate environment variables: 


echo "The path variable is $PATH" 


flavio — ba /Users/flavio — bash — 61x5 
bash-3.2$ echo "The path variable is $PATH" 
The path variable is /usr/local/bin:/usr/bin:/bin:/usr/sbin:/ 


sbin:/Library/Apple/usr/bin 
bash-3.2$ 


Beware that special characters need to be escaped with a backslash \ . $ 


for example: 


— bash /Users/f 


bash-3.2$ echo The cost is $5 
The cost is 


bash-3.2$ echo The cost is \$5 
The cost is $5 
bash-3.2$ 


This is just the start. We can do some nice things when it comes to 
interacting with the shell features. 


We can echo the files in the current folder: 


echo * 


We can echo the files in the current folder that start with the letter o : 


echo o* 


Any valid Bash (or any shell you are using) command and feature can be used 


here. 


You can print your home folder path: 


echo ~ 


bash-3.2$ echo ~ 
/Users/flavio 


bash-3.2$ 


You can also execute commands, and print the result to the standard output 
(or to file, as you saw): 


echo S$(ls -al) 


bash-3.2$ echo $(1s -al) 
total 8 drwxr-xr-x 4 flavio staff 128 Sep 3 15:43 . drwxr-xr- 
x+ 55 flavio staff 1760 Sep 3 15:20 .. -rw-r--r-- 1 flavio st 


aff 6 Sep 3 15:43 output.txt -rw-r--r-- 1 flavio staff @ Sep 
3 15:20 words.txt 
bash-3.2$ 


Note that whitespace is not preserved by default. You need to wrap the 
command in double quotes to do so: 


bash-3.2$ echo "$(ls -al)" 
total 8 
drwxr-xr-x 4 flavio staff 128 Sep 


5-15 
drwxr-xr-x+ 55 flavio staff 1760 Sep 3 15 

-rw-r--r-- 1 flavio staff 6 Sep 3 15:43 output.txt 
3.15 


-rw-r--r-- 1 flavio staff @ Sep :20 words.txt 


bash-3.2$ 


You can generate a list of strings, for example ranges: 


echo {12.51} 


bash-3.2$ echo {1..5} 
ch ei chs 


bash-3.2$ 


27. chown 


Every file/directory in an Operating System like Linux or macOS (and every 
UNIX systems in general) has an owner. 


The owner of a file can do everything with it. It can decide the fate of that file. 


The owner (and the root user) can change the owner to another user, too, 


using the chown command: 


chown <owner> <file> 


Like this: 


chown fllavao test stxt 


For example if you have a file that's owned by root , you can't write to it as 


another user: 


ray Tiav 
~ sudo touch test.tx 
- echo test >> test.txt 
<W> fish: An error occurred while redirecting file ‘'test.txt' 


open: Permission denied 


You can use chown to transfer the ownership to you: 


fi flavic 
sudo touch test.txt 
echo test 
<W> fish: An error occurred while redirecting file 'test.txt' 


open: Permission denied 
sudo chown flavio test.txt 
echo test 


It's rather common to have the need to change the ownership of a directory, 
and recursively all the files contained, plus all the subdirectories and the files 


contained in them, too. 


You can do so using the -r flag: 


chown -R <owner> <file> 


Files/directories don't just have an owner, they also have a group. Through 
this command you can change that simultaneously while you change the 


owner: 


chown <owner>:<group> <file> 


Example: 


chown flavio:users test.txt 


You can also just change the group of a file using the chgrp command: 


chgrp <group> <filename> 


28. chmod 


Every file in the Linux / macOS Operating Systems (and UNIX systems in 
general) has 3 permissions: Read, write, execute. 


Go into a folder, and run the ıs -a1 command. 


billtracker — fist 
total 1576 
drwxr-xr-x@ 13 flavio staff 416 Pi 
drwxr-xr-x@ 14 flavio staff 448 E 
-rw-r--r--@ flavio staff 6148 .DS_Store 
drwxr-xr-x@ flavio staff 448 .git/ 
-rw-r--r--@ flavio staff 214 .gitignore 
-rw-r--r--@ flavio staff 52 babel.config.js 
flavio staff 485000 package-Lock. json 
flavio staff 1083 package. json 
flavio staff 101 postcss.config.js 
flavio staff 160 public/ 
flavio staff 192 src/ 
flavio staff 27350 tailwind.js 
flavio staff 265963 yarn. Lock 
<4 > | 


-rw-r--r--@ 


-rw-r--r--@ 
-rw-r--r--@ 
drwxr-xr-x@ 
drwxr-xr-x@ 
-rw-r--r--@ 


-rw-r--r--@ 
hill¢4 


TPP OUP PRP PP 


The weird strings you see on each file line, like arwxr-xr-x , define the 
permissions of the file or folder. 


Let's dissect it. 
The first letter indicates the type of file: 


¢ - means it's a normal file 


e a means it's a directory 


e 1 means it's a link 
Then you have 3 sets of values: 


+ The first set represents the permissions of the owner of the file 

+ The second set represents the permissions of the members of the group 
the file is associated to 

+ The third set represents the permissions of the everyone else 


Those sets are composed by 3 values. rwx means that specific persona has 
read, write and execution access. Anything that is removed is swapped with a 
- , which lets you form various combinations of values and relative 


permissions: rw- , r-- , r-x , and soon. 
You can change the permissions given to a file using the chmoa command. 


chmod can be used in 2 ways. The first is using symbolic arguments, the 
second is using numeric arguments. Let's start with symbols first, which is 
more intuitive. 


You type chmoa followed by a space, and a letter: 


e a stands for all 

e u stands for user 

e g stands for group 
è o stands for others 


Then you type either + or - to adda permission, or to remove it. Then you 
enter one or more permissions symbols ( r, w, x ). 


All followed by the file or folder name. 


Here are some examples: 


chmod a+r filename #eve1 
chmod atrw filename #everyone 


chmod o-rwx filename #othe 


You can apply the same permissions to multiple personas by adding multiple 
letters before the + / - : 


chmod og-r filename #ot 


In case you are editing a folder, you can apply the permissions to every file 
contained in that folder using the -r (recursive) flag. 


Numeric arguments are faster but I find them hard to remember when you 
are not using them day to day. You use a digit that represents the 
permissions of the persona. This number value can be a maximum of 7, and 


it's calculated in this way: 


e 1 if has execution permission 
e 2 if has write permission 
e 4 ifhas read permission 


This gives us 4 combinations: 


e o no permissions 

¢ 1 can execute 

e 2 can write 

¢ 3 can write, execute 
e 4 canread 

e 5 can read, execute 
e 6 can read, write 


e 7 can read, write and execute 


We use them in pairs of 3, to set the permissions of all the 3 groups 
altogether: 


chmod 777 filename 
chmod 755 filename 


chmod 644 filename 


29. umask 


When you create a file, you don't have to decide permissions up front. 
Permissions have defaults. 


Those defaults can be controlled and modified using the umask command. 


Typing umask with no arguments will show you the current umask, in this 
case 0022 : 


bash-3.2$ umask 
0022 


bash-3.2$ 


What does 0022 mean? That's an octal value that represent the permissions. 
Another common value is 0002 . 


Use umask -s to see a human-readable notation: 


flavio — bash /Users/flavio 
bash-3.2$ umask 
0022 


bash-3.2$ umask -S 


U=rwx , g=rx, O=rx 
bash-3.2$ 


In this case, the user (u ), owner of the file, has read, write and execution 
permissions on files. 


Other users belonging to the same group (g ) have read and execution 
permission, same as all the other users ( o ). 


In the numeric notation, we typically change the last 3 digits. 
Here's a list that gives a meaning to the number: 


e o read, write, execute 
e 1 read and write 

e 2 read and execute 

e 3 read only 

e 4 write and execute 

e 5 write only 

e 6 execute only 


e 7 no permissions 
Note that this numeric notation differs from the one we use in chmoa . 


We can set a new value for the mask setting the value in numeric format: 


umask 002 


or you can change a specific role's permission: 


umask g+r 


30. du 


The au command will calculate the size of a directory as a whole: 


flavio — bash /Users/flavio — bash 


bash-3.2$ du 


32 


bash-3.2$ 


The 32 number here is a value expressed in bytes. 


Running au + will calculate the size of each file individually: 


bash-3.2$ du * 
8 Card.vue 
8 CardList.vue 


8 Form.vue 
8 HelloWorld.vue 
bash-3.2$ 


You can set au to display values in MegaBytes using du -m , and GigaBytes 


using du -g . 


The -hn option will show a human-readable notation for sizes, adapting to 
the size: 


o o flavio — bash /Users/flavio — bas 
bash-3.2$ du -h vuehandbook 
4.0K vuehandbook/12-vue-watchers 


4.0K vuehandbook/@7-vue-single-file-components 
4.0K vuehandbook/19-vue-components-communication 
84K vuehandbook/20-vuex 


48K vuehandbook/21-bonus-vue-router 
12K vuehandbook/@1-vue-introduction 
120K vuehandbook/@2-vue-first-app 
8.0K vuehandbook/@6-vue-components 
536K vuehandbook/@4-vue-devtools 


Adding the -a option will print the size of each file in the directories, too: 


ee flavio — bash /Users/flavio — bash — 65x14 
bash-3.2$ du -ah vuehandbook 
4.0K vuehandbook/12-vue-watchers/index.md 
4.0K vuehandbook/12-vue-watchers 
4.0K vuehandbook/@7-vue-single-file-components/index.md 
4.0K vuehandbook/@7-vue-single-file-components 
4.0K vuehandbook/19-vue-components-communication/index.md 
4.0K vuehandbook/19-vue-components-communication 


36K vuehandbook/20-vuex/vuex-store.png 

12K vuehandbook/20-vuex/index.md 

36K vuehandbook/2@-vuex/codesandbox. png 

84K vuehandbook/20-vuex 

12K vuehandbook/ .DS_Store 

32K vuehandbook/21-bonus-vue-router/banner. jpg 
16K vuehandbook/21-bonus-vue-router/index.md 


A handy thing is to sort the directories by size: 


Clit =a <Ci rectory || Seige ~m? 


and then piping to neaa to only get the first 10 results: 


o — bash /Users/flavio — bash — 63x13 


| head 


bash-3.2$ du -h vuehandbook | sort -nr 
932K vuehandbook/@5-vue-vscode 
636K vuehandbook/ .git/objects/75 
544K vuehandbook/@3-vue-clLi 
536K vuehandbook/@4-vue-devtools 
120K vuehandbook/@2-vue-first-app 
88K vuehandbook/ .git/objects/pack 
88K vuehandbook/ .git/objects/b@ 
84K vuehandbook/20-vuex 
76K vuehandbook/ .git/objects/6f 
64K vuehandbook/ .git/objects/41 
bash-3.2$ 


31. df 


The af command is used to get disk usage information. 


Its basic form will print information about the volumes mounted: 


ft flavio—t 
df 

Filesystem 512-blocks Used Available Capacity iused ifree %iused Mounted on 

/dev/diskis1 976490576 21974760 487735816 5% 488418 4881964462 / 

devfs 375 375 © 100% 649 V1) /dev 


/dev/diskis2 976490576 454785000 487735816 49% 4287975 4878164905 /System/Volumes/Data 
/dev/diskisS 976490576 10485848 487735816 3% 5 4882452875 /private/var/vm 
map auto_home V4) (] © 100% (] @ 100% /System/Volumes/Data/home 


Using the -n option ( af -n ) will show those values in a human-readable 
format: 


df -h 
Filesystem Size Used Avail Capacity iused ifree %iused Mounted on 
/dev/diskis1  466Gi 10Gi = 233Gi 5% 488418 4881964462 re 
devfs 188Ki 188Ki OBi 100% 649 V4) /dev 


/dev/diskis2 466Gi 217Gi 233Gi 49% 4287984 4878164896 /System/Volumes/Data 
/dev/diskisS 466Gi 5.@Gi 233Gi 5 4882452875 /private/var/vm 
map auto_home Bi Bi OBi © 100% /System/Volumes/Data/home 


You can also specify a file or directory name to get information about the 


specific volume it lives on: 


favo = Tah enea = ah SA 
df dev 

Filesystem 512-blocks Used Available Capacity iused ifree %iused Mounted on 

/dev/disk1s2 976490576 454788176 487732640 49% 4287987 4878164893 0% /System/Volumes/Data 


32. basename 


Suppose you have a path to a file, for example /users/flavio/test.txt . 


Running 


basename /Users/flavio/test.txt 


will return the test.txt string: 


basename /Users/flavio/test.txt 
test.txt 


If you run basename on a path string that points to a directory, you will get 
the last segment of the path. In this example, /users/flavio is a directory: 


@ flavio — fish /Users/fiavio fis 
~ basename /Users/flavio/ 
flavio 


~ basename /Users/flavio 
flavio 


~ 


33. dirname 


Suppose you have a path to a file, for example /users/flavio/test.txt . 


Running 


dirname /Users/flavio/test.txt 


will return the /users/filavio string: 


fi flavic fish /Users/flavio fish 44x5 
~ dirname /Users/flavio/test.txt 


/Users/flavio 


~ 


34. ps 


Your computer is running, at all times, tons of different processes. 


You can inspect them all using the ps command: 


~ ps 


PID 
59474 
941 
71366 
4216 


68714 
5088 


TTY, 

ttys@00 
ttys002 
ttys004 
ttys009 
ttys@09 
ttys013 


CMD 
/usr/local/bin/fish -1 
/usr/local/bin/fish -1 
-fish 
/usr/local/bin/fish -1 
hugo serve 

-fish 


This is the list of user-initiated processes currently running in the current 


session. 


Here I have a few fisn shell instances, mostly opened by VS Code inside the 


editor, and an instances of Hugo running the development preview of a site. 


Those are just the commands assigned to the current user. To list all 


processes we need to pass some options to ps . 


The most common I use is ps ax : 


TIME COMMAND 
724.80 /sbin/Launchd 
:03.80 /usr/sbin/syslogd 
256.03 /usr/libexec/UserEventAgent (System) 
718.74 /System/Library/PrivateFrameworks/Uninstal1.framework/Reso 
236.94 /usr/libexec/kextd 
:31.61 /System/Library/Frameworks/CoreServices. framework/Versions 
7:21.48 /System/Library/PrivateFrameworks/MediaRemote. framework/Su 
756.23 /usr/sbin/systemstats --daemon 
:25.78 /usr/lLibexec/configd 
232.22 /System/Library/CoreServices/powerd.bundle/powerd 
248.23 /usr/Libexec/logd 
:@1.46 /usr/libexec/keybagd -t 15 
231.41 /usr/Libexec/watchdogd 
2:38.55 /System/Library/Frameworks/CoreServices.framework/Framewor 
:00.55 /System/Library/CoreServices/iconservicesd 
7:49.70 /usr/libexec/diskarbitrationd 
:09.30 /usr/libexec/coreduetd 
231.22 /usr/libexec/opendirectoryd 
251.05 /System/Library/PrivateFrameworks/AppLePushService. framewo 
:00.54 /Library/PrivilegedHeLperTools/com.docker.vmnetd 
237.63 /System/Library/CoreServices/Launchservicesd 
714.36 /usr/libexec/timed 
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The a option is used to also list other users processes, not just our own. 
x shows processes not linked to any terminal (not initiated by users 


through a terminal). 


As you can see, the longer commands are cut. Use the command ps axww to 


continue the command listing on a new line instead of cutting it: 


oo 

> ~ ps axww 
TASTAT TIME COMMAND 
Tet Ss 43:25.81 /sbin/launchd 

92 ?? Ss 2:03.82 /usr/sbin/syslogd 

93 ?? Ss 4:56.05 /usr/libexec/UserEventAgent (System) 

96 ?? Ss 0:18.74 /System/Library/PrivateFrameworks/Uninstal11.framework/Res 
ources/uninstalld 

97 ?? Ss 1:36.94 /usr/libexec/kextd 

98 ?? Ss 12:31.92 /System/Library/Frameworks/CoreServices.framework/Version 
s/A/Frameworks/FSEvents. framework/Versions/A/Support/fseventsd 

99 ?? Ss 0:21.48 /System/Library/PrivateFrameworks/MediaRemote. framework/S 
upport/mediaremoted 

102 ?? Ss 22:56.23 /usr/sbin/systemstats --daemon 

103 ?? Ss 7:25.80 /usr/libexec/configd 

105 ?? Ss 732.38 /System/Library/CoreServices/powerd.bundle/powerd 

109 ?? Ss 748.48 /usr/lLibexec/Logd 

110 Ct SS 101.46 /usr/libexec/keybagd -t 15 

1S i (aos 731.42 /usr/lLibexec/watchdogd 

117 ?? Ss 44:38.88 /System/Library/Frameworks/CoreServices. framework/Framewo 
rks/Metadata. framework/Support/mds 

118 ?? Ss @:00.55 /System/Library/CoreServices/iconservicesd 


We need to specify w 2 times to apply this setting, it's not a typo. 


You can search for a specific process combining grep with a pipe, like this: 


ps axww | grep "Visual Studio Code" 


ee fi flav fish /Users/flavio 
> ~ ps axww | grep "Visual Studio Code" 

367 ?? S 40:32.47 /Applications/ .app/Contents/Mac0S/ELect 
ron -psn_@_77843 

566 ?? S 93:02.21 /Applications/ .app/Contents/Frameworks/ 
Code Helper (GPU).app/Contents/MacOS/Code Helper (GPU) --type=gpu-process --field-tr 
ial-hand1e=1718379636 , 8422946071360466993 , 8181735644596197527 ,131072 --disable-featu 
res=LayoutNG, PictureInPicture, SpareRendererForSitePerProcess --disable-color-correct 
-rendering --gpu-preferences=KAAAAAAAAAAGAAAAAAAAAAAAY AAAAAAAE AAAAAAAAAAAAAAAAAAAAAG 
BAAAgAAAAAAEAAAAAAAATAQAAAAAAABABAAAAAAAAGAE AAAAAAAAGAQAAAAAAACGBAAAAAAAAMAE AAAAAAAA 
4AQAAAAAAAEABAAAAAAAASAE AAAAAAABQAQAAAAAAAF GBAAAAAAAAY AE AAAAAAABOAQAAAAAAAHABAAAAAAA 
AeAEAAAAAAACAAQAAAAAAATGBAAAAAAAAKAE AAAAAAACY AQAAAAAAAKABAAAAAAAAGAEAAAAAAACWAQAAAAA 
AALgBAAAAAAAAWAEAAAAAAADTAQAAAAAAANABAAAAAAAAZAE AAAAAAADGAQAAAAAAA0GBAAAAAAAABAE AAAA 
AAAD4AQAAAAAAABAAAAAAAAAAAAAAAAAAAAAQAAAAAAAAAAAAAAACAAAAEAAAAAAAAAAAAAAABGAAABAAAAA 
AAAAAAAAAAACAAAAQAAAAAAAAAAAAAAATAAAAE AAAAAAAAAAAAAAACGAAABAAAAAAAAAAAAAAAASAAAAQAAA 
AAAAAAAAAAAANAAAAE AAAAAAAAAABAAAAAAAAABAAAAAAAAAAAQAAAATAAAAQAAAAAAAAAAE AAAAGAAAAEAA 
AAAAAAAABAAAABWAAABAAAAAAAAAAAQAAAAGAAAAQAAAAAAAAAAE AAAAKAAAAE AAAAAAAAAABAAAACWAAABA 
AAAAAAAAAAQAAAAGAAAAQAAAAAAAAAAQAAAAAAAAAE AAAAAAAAAAE AAAAAGAAABAAAAAAAAAABAAAAAY AAAA 
QAAAAAAAAAAQAAAAHAAAAE AAAAAAAAAAE AAAACAAAABAAAAAAAAAABAAAAAOAAAAQAAAAAAAAAAQAAAAL AAA 
AEAAAAAAAAAAEAAAADQAAABAAAAAAAAAABGAAAAAAAAAQAAAAAAAAAAY AAAACAAAAE AAAAAAAAAAGAAAABGA 
AABAAAAAAAAAABGAAAACAAAAQAAAAAAAAAAY AAAATAAAAEAAAAAAAAAAGAAAACGAAABAAAAAAAAAABGAAAAS 
AAAAQAAAAAAAAAAYAAAANAAAA --service-request-channel-token=4754214311225613582 


The columns returned by ps represent some key information. 


The first information is pip , the process ID. This is key when you want to 
reference this process in another command, for example to kill it. 


Then we have rr that tells us the terminal id used. 
Then star tells us the state of the process: 


ı a process that is idle (sleeping for longer than about 20 seconds) r a 
runnable process s a process that is sleeping for less than about 20 seconds 

t astopped process v a process in uninterruptible wait z a dead process 
(a zombie) 


If you have more than one letter, the second represents further information, 
which can be very technical. 


It's common to have + which indicates the process is in the foreground in 


its terminal. s means the process is a session leader. 


time tells us how long the process has been running. 


35. top 


A quick guide to the top command, used to list the processes running in 
real time 


The top command is used to display dynamic real-time information about 
running processes in the system. 


It's really handy to understand what is going on. 


Its usage is simple, you just type top , and the terminal will be fully 


immersed in this new view: 


avio — top /Users/flavio — top — 80x24 
Processes: 574 total, 2 running, 572 sleeping, 3807 threads 11:39:53 
Load Avg: 1.24, 1.93, 2.23 CPU usage: 4.61% user, 3.68% sys, 91.69% idle 
SharedLibs: 234M resident, 62M data, 16M Linkedit. 
MemRegions: 369828 total, 6215M resident, 163M private, 1603M shared. 
PhysMem: 14G used (3684M wired), 1742M unused. 
VM: 3@80G vsize, 1991M framework vsize, 316459873(128) swapins, 322451178(@) swa 
Networks: packets: 41309179/63G in, 44958830/24G out. 

i : 68270763/1950G read, 43422129/1680G written. 


COMMAND nadi TIME #TH #WQ #PORT MEM PURG CMPRS 
WindowServer 16.1 13:11: 10 6607+ 845M+ 1216K- 
com.docker.h 7. 15:21: 18 42 2374M 

top 00:01. 1/1 27+ 8352K+ 
Terminal 11 436 105M 
1Password 7 8 2473- 530M- 
kernel_task 262/12 i) 510M+ 

Google Chrom 16 209 81M 

Bear 12 1760- 557M- 

Books 6 822 302M 

cloudd 16 785+ 31M+ 

hidd 7 560 7208K 

Music 22 684 201M+ 
bLuetoothd 3 801 18M 

Rectangle 3 210- 52M- 
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The process is long-running. To quit, you can type the q letteror ctri-c. 


There's a lot of information being given to us: the number of processes, how 
many are running or sleeping, the system load, the CPU usage, and a lot 
more. 


Below, the list of processes taking the most memory and CPU is constantly 
updated. 


By default, as you can see from the sceu column highlighted, they are sorted 
by the CPU used. 


You can add a flag to sort processes by memory utilized: 


top -o mem 


36. kill 


Linux processes can receive signals and react to them. 


That's one way we can interact with running programs. 


The «ill program can send a variety of signals to a program. 


It's not just used to terminate a program, like the name would suggest, but 


that's its main job. 


We use it in this way: 


KanN ETD 


By default, this sends the term signal to the process id specified. 


We can use flags to send other signals, including: 


re S SDD 
KOL SNE SRDS 
seal SIRE < DDS 
K METERME PD 


KUL SCONE <P IDS 
SUL =OP <PIUDA 


nup means hang up. It's sent automatically when a terminal window that 


started a process is closed before terminating the process. 


INT means interrupt, and it sends the same signal used when we press 


ctrl-c in the terminal, which usually terminates the process. 


KILL is not sent to the process, but to the operating system kernel, which 


immediately stops and terminates the process. 


T 


ERM Means terminate. The process will receive it and terminate itself. It's 


the default signal sent by xi11 . 


cont means continue. It can be used to resume a stopped process. 


S 


top is not sent to the process, but to the operating system kernel, which 


immediately stops (but does not terminate) the process. 


You might see numbers used instead, like ki11 -1 <prp> . In this case, 


1 corresponds to nur . 2 corresponds to intr. 9 corresponds to KILL. 


15 corresponds to term. 18 corresponds to contr. 15 corresponds to 


STOP . 


37. killall 


Similar to the xii1 command, xiilaii instead of sending a signal to a 


specific process id will send the signal to multiple processes at once. 


This is the syntax: 


killall <name> 


where name is the name of a program. For example you can have multiple 
instances of the top program running, and killall top will terminate 
them all. 


You can specify the signal, like with xiii (and check the xi11 tutorial to 
read more about the specific kinds of signals we can send), for example: 


Teak DIGELIEIE, >E Od 


38. jobs 
When we run a command in Linux / macOS, we can set it to run in the 
background using the « symbol after the command. For example we can 


run top inthe background: 


top & 


This is very handy for long-running programs. 


We can get back to that program using the fg command. This works fine if 
we just have one job in the background, otherwise we need to use the job 
number: fg 1 , fg 2 and so on. To get the job number, we use the jobs 
command. 


Say we run top « and then top -o mem « , SO we have 2 top instances 


running. jobs will tell us this: 


bash-3.2$ jobs 
[1]- Stopped 
[2]+ Stopped 


bash-3.2$ 


Now we can switch back to one of those using fg <jobia> . To stop the 
program again we can hit cma-z . 


Running jobs -1 will also print the process id of each job. 


39. bg 


When a command is running you can suspend it using ctri-z . 
The command will immediately stop, and you get back to the shell terminal. 


You can resume the execution of the command in the background, so it will 
keep running but it will not prevent you from doing other work in the 


terminal. 


In this example I have 2 commands stopped: 


ł flavio — bash /Users/flavio — bash — 61x5 


bash-3.2$ jobs 
[1]+ Stopped top (wd: ~) 


[2]- Stopped top -o mem (wd: ~) 
bash-3.2$ 


I can run bg 1 to resume in the background the execution of the job #1. 


I could have also said bg without any option, as the default is to pick the job 
#1 in the list. 


40. fg 


When a command is running in the background, because you started it with 
« atthe end (example: top « or because you put it in the background with 
the bg command, you can put it to the foreground using fg. 


Running 
fg 


will resume to the foreground the last job that was suspended. 


You can also specify which job you want to resume to the foreground passing 
the job number, which you can get using the jobs command. 


bash-3.2$ jobs 
[1]+ Stopped top (wd: ~) 
[2]- Stopped top -o mem (wd: ~) 


bash-3.2$ 


Running fg 2 will resume job #2: 


o o flavio — bash /Users/flavio — top — 61x23 
Processes: 574 total, 2 running, 572 sleeping, 3823 threads 
16:12:54 Load Avg: 1.44, 1.60, 1.74 
CPU usage: 3.76% user, 2.99% sys, 93.23% idle 
SharedLibs: 235M resident, 62M data, 16M linkedit. 
MemRegions: 365072 total, 6752M resident, 166M private, 1835M 
PhysMem: 15G used (3692M wired), 738M unused. 
VM: 3092G vsize, 1991M framework vsize, 318057086(0) swapins, 
Networks: packets: 43489522/66G in, 47248873/25G out. 
Disks: 69434725/1968G read, 44158267/1695G written. 


PID COMMAND %CPU TIME #WQ #PORT R 


1185  com.docker.h 
Code Helper 
hugo 
WindowServer 
1Password 7 
Bear 
Code Helper 
Photos 
Figma Helper 
kernel_task 
Google Chrom 
Code Helper 


2374M 
1606M 
1029M 
851M 
581M 
570M-+ 
557M 
524M 
522M 
514M 
506M 


471M 
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41. type 


A command can be one of those 4 types: 


e an executable 
e a shell built-in program 
e a shell function 


e an alias 


The type command can help figure out this, in case we want to know or 
we're just curious. It will tell you how the command will be interpreted. 


The output will depend on the shell used. This is Bash: 


bash-3.2$ type ls 

ls is hashed (/bin/1s) 
bash-3.2$ type cat 

cat is /bin/cat 

bash-3.2$ type pwd 

pwd is a shell builtin 
bash-3.2$ type 11 

1l is aliased to “ls -al' 
bash-3.2$ type top 

top is hashed (/usr/bin/top) 
bash-3.2$ type jobs 

jobs is a shell builtin 
bash-3.2$ type bg 

bg is a shell builtin 
bash-3.2$ type kill 

kill is a shell builtin 
bash-3.2$ type top 

top is hashed (/usr/bin/top) 
bash-3.2$ 


This is Zsh: 


flavio@mbp ~ % type ls 
ls is /bin/1s 

flavio@mbp ~ % type cat 
cat is /bin/cat 
flavio@mbp ~ % type pwd 
pwd is a shell builtin 
flavio@mbp ~ % type 11 
1l not found 

flavio@mbp ~ % alias ll='ls -al' 
flavio@mbp ~ % type 11 
ll is an alias for ls -al 
flavio@mbp ~ % type top 
top is /usr/bin/top 
flavio@mbp ~ % type jobs 
jobs is a shell builtin 
flavio@mbp ~ % type bg 
bg is a shell builtin 
flavio@mbp ~ % type kill 
kill is a shell builtin 
flavio@mbp ~ % type top 
top is /usr/bin/top 
flavio@mbp ~ % 


This is Fish: 


eo 
+ ~ type ls 
ls is a function with definition 
# Defined in /usr/local/Cellar/fish/3.1.0/share/fish/functions/ls.fish @ line 13 
function ls --description 'List contents of directory' 
set -l opt -G 
isatty stdout 
and set -a opt -F 
command ls $opt $argv 
end 
>+ ~ type cat 
cat is /bin/cat 
+» ~ type pwd 
pwd is a builtin 
+ ~ type LL 
ll is a function with definition 
# Defined in /usr/local/Cellar/fish/3.1.0/share/fish/functions/ll.fish @ line 4 
function 11 --description 'List contents of directory using long format' 
ls -lh $argv 
end 
+ ~ type top 
top is /usr/bin/top 
+» ~ type jobs 
jobs is a builtin 
+ ~ type bg 
bg is a function with definition 
# Defined in /usr/local/Cellar/fish/3.1.0/share/fish/config.fish @ line 274 
function bg 
set -l jobbltn bg 
builtin $jobbltn (__fish_expand_pid_args $argv) 
end 
> ~ type kill 
kill is a function with definition 
# Defined in /usr/local/Cellar/fish/3.1.0/share/fish/config.fish @ line 279 
function kill 
command kill (__fish_expand_pid_args $argv) 
end 
+ ~ type top 
top is /usr/bin/top 


-p ~ 


One of the most interesting things here is that for aliases it will tell you what 
is aliasing to. You can see the 11 alias, in the case of Bash and Zsh, but Fish 
provides it by default, so it will tell you it's a built-in shell function. 


42. which 


Suppose you have a command you can execute, because it's in the shell path, 
but you want to know where it is located. 


You can do so using which . The command will return the path to the 
command specified: 


ĝi flavio — fish /l 
~ which ls 
/bin/1s 


~ which docker 


/usr/Local/bin/docker 


~ 


which will only work for executables stored on disk, not aliases or built-in 
shell functions. 


43. nohup 
Sometimes you have to run a long-lived process on a remote machine, and 
then you need to disconnect. 


Or you simply want to prevent the command to be halted if there's any 
network issue between you and the server. 


The way to make a command run even after you log out or close the session 


to a server is to use the nohup command. 


Use nohup <command> to let the process continue working even after you log 
out. 


44. xargs 


The xargs command is used in a UNIX shell to convert input from standard 


input into arguments to a command. 


In other words, through the use of xargs the output of a command is used 
as the input of another command. 


Here's the syntax you will use: 


commandl | xargs command2 


We use a pipe ( | ) to pass the output to xargs . That will take care of 
running the command2 command, using the output of command as its 


argument(s). 


Let's do a simple example. You want to remove some specific files from a 
directory. Those files are listed inside a text file. 


We have 3 files: file1 , file2 , file3. 


In todelete.txt Wwe have a list of files we want to delete, in this example 


filel and file3: 


vio/testing — -fish — 62x7 


file2 file3 todeLlete.txt 
sting cat todelete.txt 


We will channel the output of cat todelete.txt to the rm command, 
through xargs. 


In this way: 


cat todelete.txt | xargs rm 


That's the result, the files we listed are now deleted: 


-fish — 62x10 


todeLlete.txt 


ting cat todelete.txt | xargs rm 


todelete.txt 


The way it works is that xargs will run rm 2 times, one for each line 
returned by cat . 


This is the simplest usage of xargs . There are several options we can use. 


One of the most useful in my opinion, especially when starting to learn 
xargs , IS -p . Using this option will make xargs print a confirmation 
prompt with the action it's going to take: 


testing 


t j — cat /Users/flavio/testing — xargs -p rm — 44x5 
testing cat todelete.txt | xargs -p rm 
rm file1 file3?... 


The -n option lets you tell xargs to perform one iteration at a time, so you 
can individually confirm them with -p . Here we tell xargs to perform one 
iteration at a time with -n1 : 


cat todelete.txt | xargs -p -n1 rm 
rm filei?... 


The -1 option is another widely used one. It allows you to get the output 
into a placeholder, and then you can do various things. 


One of them is to run multiple commands: 


commandl | xargs -I % /bin/bash -c 'command2 %; command3 %' 


c $ | 
b Sh -c 


testing cat todeta. txt L xargs -p SI % sh -c ‘ls 
sh -c ls filel; rm file1?. 


You can swap the s symbol I used above with anything else, it's a 
variable 


45. vim 


vim 1s a very popular file editor, especially among programmers. It's 
actively developed and frequently updated, and there's a very big community 
around it. There's even a Vim conference! 


vi in modern systems is just an alias to vim , which means vi i m proved. 


You start it by running vi onthe command line. 


test—vi /Users/flaviocopes/test — vi — 88x23 


VIM - Vi IMproved 


version 8.0.1283 
by Bram Moolenaar et al. 
is open source and freely distributable 


Help poor children in Uganda! 
shelp iccf<Enter> for information 


:q<Enter> to exit 
shelp<Enter> or <F1> for on-line help 
:help version&<Enter> for version info 


You can specify a filename at invocation time to edit that specific file: 


vi test.txt 


test—vi /Users/flaviocopes/test — vi test.txt — 75x21 


"test.txt" [New File] 


You have to know that Vim has 2 main modes: 


¢ command (or normal) mode 


e insert mode 


When you start the editor, you are in command mode. You can't enter text 


like you expect from a GUI-based editor. You have to enter insert mode. 


You can do this by pressing the i key. Once you do so, the -- rns 


word appear at the bottom of the editor: 


test— vi /Users/flaviocopes/test — vi test.txt — 88x23 


Now you can start typing and filling the screen with the file contents 


HIE c= 


test—vi /Users/flaviocopes/test — vi test.txt — 88x23 


This is a very cool editor 


It's called Vim! 


You can move around the file with the arrow keys, or using the n - 3 - k - 
1 keys. n-1 for left-right, j-x for down-up. 


Once you are done editing you can press the esc key to exit insert mode, 
and go back to command mode. 


coe test— vi /Users/flaviocopes/test — vi test.txt — 88x23 


Hey 
This is a very cool editor 


It's called Vimi 


At this point you can navigate the file, but you can't add content to it (and be 
careful which keys you press as they might be commands). 


One thing you might want to do now is saving the file. You can do so by 
pressing : (colon), then w . 


You can save and quit pressing : then w and q: :wq 
You can quit without saving, pressing : then q and ! : :q! 


You can undo and edit by going to command mode and pressing u . You 
can redo (cancel an undo) by pressing ctri-r . 


Those are the basics of working with Vim. From here starts a rabbit hole we 
can't go into in this little introduction. 


I will only mention those commands that will get you started editing with 
Vim: 


e pressing the x key deletes the character currently highlighted 

+ pressing a goes at the end of the currently selected line 

e press o to goto the start of the line 

+ go to the first character of a word and press a followed by w to delete 
that word. If you follow it with e instead of w , the white space before 
the next word is preserved 

e use a number between a and w to delete more than 1 word, for 
example use a3w to delete 3 words forward 

e press a followed by a to delete a whole entire line. Press a followed 
by s to delete the entire line from where the cursor is, until the end 


To find out more about Vim I can recommend the Vim FAQ and especially 
running the vimtutor command, which should already be installed in your 
system and will greatly help you start your vim explorations. 


46. emacs 


emacs 1S an awesome editor and it's historically regarded as the editor for 
UNIX systems. Famously vi vs emacs flame wars and heated discussions 
caused many unproductive hours for developers around the world. 


emacs is very powerful. Some people use it all day long as a kind of 
operating system (https://news.ycombinator.com/item?id=19127258). We'll 
just talk about the basics here. 


You can open a new emacs session simply by invoking emacs : 


test— emacs /Users/flaviocopes/test — emacs — 88x27 
File Edit Options Buffers Tools Help S 
elcome to GNU Emacs, a part of the GNU operating system. 
Get help (Hold down CTRL and press h) 


C- 
Undo changes C- 
Exit Emacs C- 


(‘C-' means use the CTRL key. ‘M-’ means use the Meta (or Alt) key. 
If you have no Meta key, you may instead type ESC followed by the character.) 
Useful tasks: 


GNU Emacs 26.1 (build 1, x86_64-apple-darwin18.2.0) 
of 2019-01-16 
Copyright (C) 2018 Free Software Foundation, Inc. 


GNU Emacs comes with ABSOLUTELY NO WARRANTY; type C-h C-w for 

Emacs is Free Software--Free as in Freedom--so you can redistribute copies. 
of Emacs and modify it; type C-h C-c to see 

Type C-h C-o for information on 


-UUU:%%--F1 *GNU Emacs* ALL L1 (Fundamental) 
For information about GNU Emacs and the GNU system, type C-h C-a. 


macOS users, stop a second now. If you are on Linux there are no 
problems, but macOS does not ship applications using GPLv3, and every 
built-in UNIX command that has been updated to GPLv3 has not been 
updated. While there is a little problem with the commands I listed up to 
now, in this case using an emacs version from 2007 is not exactly the 
same as using a version with 12 years of improvements and change. This 
is not a problem with Vim, which is up to date. To fix this, run brew 
install emacs and running emacs will use the new version from 


Homebrew (make sure you have Homebrew installed) 


You can also edit an existing file calling emacs <filename> : 


test—emacs / rs/flaviocopes/test — emacs test.txt — 88x27 
File Edit Options Buffers Tools Text Help 
ey 


This is a very cool editor 


It's called Emacs! 


-UU-:----F1 test.txt ALL L1 
For information about GNU Emacs and the GNU system, type C-h C-a. 


You can start editing and once you are done, press ctri-x followed by 
ctrl-w . You confirm the folder: 


ce test— emacs /Users/flaviocopes/test — emacs test.txt — 88x27 


File Edit Options Buffers Tools Minibuf Help B 


Hey 


This is a very cool editor 


It's called Emacs! 


-UU-:**--F1 test.txt All L7 (Text) 


and Emacs tell you the file exists, asking you if it should overwrite it: 


oeo test— emacs /Users/flaviocopes/test — emacs test.txt — 88x27 


File Edit Options Buffers Tools Text Help 2 


Hey 
This is a very cool editor 


It's called Emacs! 


-UU-:**--F1 test.txt ALL L7 (Text) 


Answer y , and you get a confirmation of success: 


test—emacs /Users/flaviocopes/test — emacs test.txt — 88x27 


File Edit Options Buffers Tools Text Help a 
Hey 


This is a very cool editor 


It's called Emacs! 


-UU-:----F1 test.txt ALL L7 (Text) 
Wrote /Users/flaviocopes/test/test.txt 


You can exit Emacs pressing ctri-x followed by ctri-c . Or ctri-x 
followed by c (keep ctri pressed). 


There is a lot to know about Emacs. More than I am able to write in this little 
introduction. I encourage you to open Emacs and press ctri-h r to open 
the built-in manual and ctri-h t to open the official tutorial. 


47. nano 


nano is a beginner friendly editor. 
Run it using nano <filename>. 
You can directly type characters into the file without worrying about modes. 


You can quit without editing using ctri-x . If you edited the file buffer, the 
editor will ask you for confirmation and you can save the edits, or discard 
them. The help at the bottom shows you the keyboard commands that let you 


work with the file: 


ee test— nano /Users/flaviocopes/test — nano test2 — 82x23 


GNU nano 2.0.6 New Buffer Modified K 


testing] 


Wel Get Help W WriteOut @ Read File $ý Prev Page WX Cut Text We Cur Pos 
We Exit We) Justify W Where Is WY Next Page @ UnCut Texti] To Spell 


pico is more or less the same, although nano is the GNU version of pico 
which at some point in history was not open source and the nano clone was 
made to satisfy the GNU operating system license requirements. 


48. whoami 


Type whoami to print the user name currently logged in to the terminal 
session: 


© © ĝi flavio — fish /Users/flavio — -fish — 35 
~ whoam1 


Note: this is different from the who am i command, which prints more 


information 


49. who 


The who command displays the users logged in to the system. 


Unless you're using a server multiple people have access to, chances are you 
will be the only user logged in, multiple times: 


~ who 
flavio console Aug 13 12:52 
flavio ttys@@4 Sep 2 12:22 


flavio ttys@@6 Sep 2 12:26 
flavio ttys@@7 Sep 3 11:39 
flavio ttys@13 Aug 28 16:49 


~ 


Why multiple times? Because each shell opened will count as an access. 


You can see the name of the terminal used, and the time/day the session was 
started. 


The -an flags will tell wno to display more information, including the idle 
time and the process ID of the terminal: 


ee 
> ~ who -aH 
USER LINE COMMENT 
reboot ~ 
flavio console 
flavio ttys000 : term=0 exit=0 
flavio ttys004 
flavio ttys@Q6 
flavio ttysQ7 
flavio ttys008 21 14: term=@ exit=0 
flavio ttys009 15719: term=0 exit=0 
flavio ttys010 23716: 2 term=@ exit=0 
flavio ttys011 21 10: term=0 exit=0 
flavio ttys@13 Aug 28 

: : run-level 3 


The special who am i command will list the current terminal session details: 


fi flavio 
> ~ who ami 
flavio ttys0@04 Sep 2 12:22 


> ~ 


ee 
> ~ who -aH ami 
USER LINE WHEN COMMENT 
flavio ttys@@4 Sep 2 12:22 


> ~ 


50. su 


While you're logged in to the terminal shell with one user, you might have the 
need to switch to another user. 


For example you're logged in as root to perform some maintenance, but then 
you want to switch to a user account. 


You can do so with the su command: 


su <username> 


For example: su flavio . 


If you're logged in as a user, running su without anything else will prompt 
to enter the root user password, as that's the default behavior. 


SU 
Password: 


su will start a new shell as another user. 


When you're done, typing exit in the shell will close that shell, and will 
return back to the current user's shell. 


51. sudo 


sudo is commonly used to run a command as root. 


You must be enabled to use sudo , and once you do, you can run commands 
as root by entering your user's password (not the root user password). 


The permissions are highly configurable, which is great especially in a multi- 
user server environment, and some users can be granted access to running 
specific commands through sudo . 


For example you can edit a system configuration file: 


sudo nano /etc/hosts 


which would otherwise fail to save since you don't have the permissions for it. 


You can run sudo -i to start a shell as root: 


sudo /Users/flavio — bash — 42x6 


Sudo 
Password: 
mbp:~ root# 


You can use sudo to run commands as any user. roct is the default, but 
use the -u option to specify another user: 


sudo -u flavio ls /Users/flavio 


52. passwd 


Users in Linux have a password assigned. You can change the password using 


the passwa command. 


There are two situations here. 


The first is when you want to change your password. In this case you type: 


passwd 


and an interactive prompt will ask you for the old password, then it will ask 
you for the new one: 


flavio — passwd /Users/flavio — passwd — 35x5 
~ passwd 
Changing password for flavio. 


Old Password: 


When you're root (or have superuser privileges) you can set the username 
of which you want to change the password: 


passwd <username> <new password> 


In this case you don't need to enter the old one. 


93. ping 
The ping command pings a specific network host, on the local network or 


on the Internet. 


You use it with the syntax ping <host> where <host> could be a domain 


name, or an IP address. 


Here's an example pinging google.com : 


ee 
> ~ ping google.com 
PING google.com (216.58.205.78): 56 data bytes 
64 bytes from 216.58.205.78: icmp_seq=@ tt1=118 time=32.823 
64 bytes from 216.58.205.78: icmp_seq=1 tt1=118 time=39.248 
64 bytes from 216.58.205.78: icmp_seq=2 tt1l=118 time=19.987 
64 bytes from 216.58.205.78: icmp_seq=3 tt1l=118 time=29.539 


64 bytes from 216.58.205.78: icmp_seq=4 tt1=118 time=18.@11 
AC 

--- google.com ping statistics --- 

5 packets transmitted, 5 packets received, 0.0% packet loss 
round-trip min/avg/max/stddev = 18.011/27.922/39.248/7.951 ms 


> ~ 


The commands sends a request to the server, and the server returns a 


response. 


ping keep sending the request every second, by default, and will keep 
running until you stop it with ctri-c , unless you pass the number of times 


you want to try with the -c option: ping- Cue googlemcom . 


Once ping is stopped, it will print some statistics about the results: the 
percentage of packages lost, and statistics about the network performance. 


As you can see the screen prints the host IP address, and the time that it took 
to get the response back. 


Not all servers support pinging, in case the requests times out: 


ee fi flavio — fish /Users/flavio — -fish — 72x11 
+ ~ ping flaviocopes.com 
PING flaviocopes.com (167.99.137.12): 56 data bytes 
Request timeout for icmp_seq @ 
Request timeout for icmp_seq 1 
Request timeout for icmp_seq 2 


Request timeout for icmp_seq 3 

AC 

--- flaviocopes.com ping statistics --- 

5 packets transmitted, @ packets received, 100.0% packet loss 


~ 


Sometimes this is done on purpose, to "hide" the server, or just to reduce the 
load. The ping packets can also be filtered by firewalls. 


ping works using the ICMP protocol (Internet Control Message 
Protocol), a network layer protocol just like TCP or UDP. 


The request sends a packet to the server with the zcuo request Message, and 


the server returns a rcHo REPLY message. I won't go into details, but this is 


the basic concept. 


Pinging a host is useful to know if the host is reachable (supposing it 
implements ping), and how distant it is in terms of how long it takes to get 
back to you. Usually the nearest the server is geographically, the less time it 
will take to return back to you, for simple physical laws that cause a longer 
distance to introduce more delay in the cables. 


54. traceroute 


When you try to reach a host on the Internet, you go through your home 
router, then you reach your ISP network, which in turn goes through its own 
upstream network router, and so on, until you finally reach the host. 


Have you ever wanted to know what are the steps that your packets go 
through to do that? 


The traceroute command is made for this. 


You invoke 


traceroute <host> 


and it will (slowly) gather all the information while the packet travels. 


In this example I tried reaching for my blog with traceroute 


flaviocopes.com : 


traceroute flaviocopes.com 

traceroute: Warning: flaviocopes.com has multiple addresses; using 142.93.108.123 
traceroute to flaviocopes.com (142.93.108.123), 64 hops max, 52 byte packets 

1 192.168.1.1 (192.168.1.1) 3.090 ms 2.391 ms 2.231 ms 
pppoe-server.net.ngi.it (81.174.0.21) 10.697 ms 20.802 ms 21.329 ms 

* * * 

10.40.83.89 (10.40.83.89) 374.040 ms 1258.538 ms * 

10.40.4.177 (10.40.4.177) 21.893 ms 20.705 ms 20.912 ms 

* * * 


ffm-bb2-Link.telia.net (62.115.116.172) 28.671 ms 39.589 ms * 
* * * 
digitalocean-ic-328177-ffm-b4.c.telia.net (80.239.128.21) 172.565 ms 173.744 ms 


digitalocean-ic-328178-ffm-b4.c.telia.net (80.239.128.23) 316.124 ms 
* * * 


2 
3 
4 
5 
6 
7 
8 
9 


* * * 
* * * 


142.93.108.123 (142.93.108.123) 207.791 ms !Z 32.786 ms !Z 23.561 ms !Z 


Not every router travelled returns us information. In this case, traceroute 
prints « » « . Otherwise, we can see the hostname, the IP address, and some 
performance indicator. 


For every router we can see 3 samples, which means traceroute tries by 
default 3 times to get you a good indication of the time needed to reach it. 
This is why it takes this long to execute traceroute compared to simply 
doing a ping to that host. 


You can customize this number with the -q option: 


traceroute -q 1 flaviocopes.com 


ee fi flavio — fish /Users/flavio — -fish — 86x17 
~ traceroute -q 1 flaviocopes.com 
traceroute: Warning: flaviocopes.com has multiple addresses; using 167.99.137. 
traceroute to flaviocopes.com (167.99.137.12), 64 hops max, 52 byte packets 
192.168.1.1 (192.168.1.1) 6.441 ms 
pppoe-server.net.ngi.it (81.174.0.21) 17.438 ms 
* 


10.40.83.89 (10.40.83.89) 30.463 ms 

10.40.4.177 (10.40.4.177) 22.037 ms 
mno-b2-Link.telia.net (62.115.57.249) 20.573 ms 
ffm-bb2-Link.telia.net (62.115.116.172) 27.682 ms 
* 


digitalocean-ic-328178-ffm-b4.c.telia.net (80.239.128.23) 137.439 ms 
w 


* 


* 


167.99.137.12 (167.99.137.12) 35.460 ms !Z 


55. clear 


Type clear to clear all the previous commands that were ran in the current 


terminal. 


The screen will clear and you will just see the prompt at the top: 


Note: this command has a handy shortcut: ctri-1 


Once you do that, you will lose access to scrolling to see the output of the 


previous commands entered. 


So you might want to use clear -x instead, which still clears the screen, but 
lets you go back to see the previous work by scrolling up. 


56. history 


Every time we run a command, that's memorized in the history. 


You can display all the history using: 


igisieconay/ 


This shows the history with numbers: 


passwd 

passwd -S 

tldr we 

cat test >> test.txt 
echo test >> test.txt 
wc test.txt 

we -L test.txt 

ls -al | we 

ls -al | we -l 

tldr open 

open . 

open -R test.txt 
tldr history 

history 

history 

2$ 


You can use the syntax !<command number> to repeat a command stored in 
the history, in the above example typing :121 willrepeatthe is -al | we - 


1 command. 


Typically the last 500 commands are stored in the history. 


You can combine this with grep to find a command you ran: 


history | grep docker 


nao bach Uerj 
bash-3.2$ history | grep docker 
git clone https://github.com/docker/getting-started.git 
git clone https://github.com/docker/getting-started.git 
docker container stop $Cdocker container 1s) 


15 docker container stop $(docker container ls) 
16 docker container stop $Cdocker container ls -aq) 
130 history | grep docker 
bash-3.2$ 


To clear the history, run history -c 


57. export 


The export command is used to export variables to child processes. 
What does this mean? 


Suppose you have a variable TEST defined in this way: 


TES Lowest! 


You can print its value using echo $TEST : 


bash-3.2$ echo $TEST 
test 


bash-3.2$ 


But if you try defining a Bash script in a file script.sn with the above 


command: 


avio — bash /Users/flavio — nano script.sh — 61x12 


GNU nano 2.0.6 File: script.sh Modified 


#!/bin/bash 
echo $TEST 


We Get Helo Write0uWy Read Fii Prev Pa Cut Tex Cur Pos 
Od Exit @) Justif Where IgM) Next Pag] UnCut To Spell 


Then you set chmod u+x script.sh and you execute this script with 


./script.sh , the echo srest line will print nothing! 


This is because in Bash the test variable was defined local to the shell. 


When executing a shell script or another command, a subshell is launched to 
execute it, which does not contain the current shell local variables. 


To make the variable available there we need to define test not in this way: 


TEST="test" 


but in this way: 


export TEST="test" 


Try that, and running ./script.sh now should print "test": 


— bash /Users/fla 


bash-3.2$ export TEST="test" 
bash-3.2$ ./script.sh 
test 


bash-3.2$ 


Sometimes you need to append something to a variable. It's often done with 
the raru variable. You use this syntax: 


export PATH=SPATH:/new/path 


It's common to use export when you create new variables in this way, but 
also when you create variables in the  .bash profile or -bashre 


configuration files with Bash, or in .zshenv with Zsh. 


To remove a variable, use the -n option: 


export Sn TESE 


Calling export without any option will list all the exported variables. 


58. crontab 


Cron jobs are jobs that are scheduled to run at specific intervals. You might 
have a command perform something every hour, or every day, or every 2 
weeks. Or on weekends. They are very powerful, especially on servers to 


perform maintenance and automations. 
The crontab command is the entry point to work with cron jobs. 


The first thing you can do is to explore which cron jobs are defined by you: 


crontab -l 


You might have none, like me: 


crontab -l 
crontab: no crontab for flavio 


Run 


crontab c 


to edit the cron jobs, and add new ones. 


By default this opens with the default editor, which is usually vim . I like 
nano more, you can use this line to use a different editor: 


EDITOR=nano crontab -e 


Now you can add one line for each cron job. 


The syntax to define cron jobs is kind of scary. This is why I usually use a 
website to help me generate it without errors: https://crontab-generator.org/ 


© Crontab Generator - Generate X + 


C @ crontab-generator.org 


Crontab Generator 


e Get frustrated with Cron on your server? Try our Webcron Service 


If you want to periodically perform a task (e.g. sending Emails, backing up database, doing regular maintenance, etc.) at specified times and dates, there are 
two ways to set scheduled tasks 


Method 1: Use our online cron job service that will save you a headache. 
Method 2: Use Cron available in Unix/Linux systems 


If you go with method 2, the following generator can help you produce a crontab syntax that you can copy & paste to your crontab file (You can open the file 
by using command crontab -e ). Below the generated crontab syntax, a list of run times will be displayed too. The predictions will help you ensure that you 


set the time and date right. 


Complete the following form to generate a crontab line 


Ctrl-click (or command-click on the Mac) to select multiple entries 


Minutes Hours Days 
© i © © 
@ Every Minute 5/0 ® Every Hour >| Midnight @ Every Day l 
Even Minutes 1 ) Even Hours 1am ) Even Days 2 
Odd Minutes 2 ) Odd Hours 2am Odd Days 3 
a 3 x 3am a 4 
Every 5 Minutes 4 ) Every 6 Hours amin Every 5 Days 5 
Every 15 Minutes 5 D Every 12 Hours 5am ) Every 10 Days 6 
> Every 30 Minutes 6 6am > Every Half Month T 
7 7am 8 
8 8am 9 
9 gam 10 
Months Weekday 
@ Every Month N jan @ Every Weekday OÍ sun 
D Even Months Feb D Monday-Friday Mon 
© Odd Months Mar D Weekend Days Tue 
š Apr Wed 
D Every 4 Months May Thu 
© Every Half Year Jun Fri 
Jul Sat 
Aug 
Sep 
Oct 


Command To Execute 


Command Examples: 
Execute PHP script 


You pick a time interval for the cron job, and you type the command to 
execute. 


I chose to run a script located in /users/flavio/test.sh every 12 hours. This 
is the crontab line I need to run: 


* */12 * * * /Users/flavio/test.sh >/dev/null 2>6&1 


I run crontab -e : 


EDITOR=nano crontab -e 


and I add that line, then I press ctri-x and press y to save. 


If all goes well, the cron job is set up: 


bash /Users/flavio 


bash-3.2$ EDITOR=nano crontab -e 
crontab: no crontab for flavio - using an empty one 


crontab: installing new crontab 
bash-3.2$ 
bash-3.2$ 


Once this is done, you can see the list of active cron jobs by running: 


crontab] 


avio — basł 


bash-3.2$ crontab -1l 
* */12 * * * /Users/flavio/test.sh >/dev/null 2>&1 


bash-3.2$ 


You can remove a cron job running crontab -e again, removing the line and 


exiting the editor: 


— sh /Users/flavio — nano « crontab — 61 


GNU nano 2.0.6 ari lee Hem fenonkabe SOt2KZmTC Modified 


Save modified buffer CANSWERING "No" WILL DESTROY CHANGES) ? 


Cancel 


flavio — bash /Us 


bash-3.2$ EDITOR=nano ae -e 
crontab: installing new crontab 
bash-3.2$ crontab -1 


bash-3.2$ 


59. uname 


Calling uname without any options will return the Operating System 
codename: 


o o 
~ uname 
Darwin 


~ 


The m option shows the hardware name ( xs6_64 in this example) and the 
p option prints the processor architecture name ( i386 in this example): 


o o 
~ uname -mp 
x86_64 1386 


~ 


bad 


The s option prints the Operating System name. r prints the release, v 


prints the version: 


ee ff flavio 
> ~ uname -srv 
Darwin 19.6.0 Darwin Kernel Version 19.6.0: 
Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153. 
141.1~1/RELEASE_X86_64 


-> ~ 


The n option prints the node network name: 


o o @ flavio - 
> ~ uname -N 
mbp. Local 


-> ~ 


The a option prints all the information available: 


| o fi flavio 


> ~ uname -a 
Darwin mbp.local 19.6.0 Darwin Kernel Versio 
n 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root 
:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 


-> ~ 


On macOS you can also use the sw vers command to print more 
information about the macOS Operating System. Note that this differs from 
the Darwin (the Kernel) version, which above is 19.6.0 . 


Darwin is the name of the kernel of macOS. The kernel is the "core" of 
the Operating System, while the Operating System as a whole is called 
macOS. In Linux, Linux is the kernel, GNU/Linux would be the 


Operating System name, although we all refer to it as "Linux" 


> ~ Sw_vers 
ProductName : Mac OS X 
ProductVersion: 10.15.6 
BuildVersion: 19G2021 


-> ~ 


60. env 


The env command can be used to pass environment variables without 


setting them on the outer environment (the current shell). 


Suppose you want to run a Node.js app and set the user variable to it. 


You can run 


env USER=flavio node app.js 


and the user environment variable will be accessible from the Node.js app 


via the Node process.env interface. 


You can also run the command clearing all the environment variables already 
set, using the -i option: 


env -i node app.js 


In this case you will get an error saying env: node: No such file or 
directory because the node command is not reachable, as the parts 
variable used by the shell to look up commands in the common paths is 


unset. 


So you need to pass the full path to the node program: 


env -i /usr/local/bin/node app.js 


Try with a simple app.js file with this content: 


console.log(process.env.NAME) 


console.log(process.env. PATH) 


You will see the output being 


undefined 


undefined 


You can pass an env variable: 


env -i NAME=flavio node app.js 


and the output will be 


iE ILSNWAL) 


undefined 


Removing the -i option will make pars available again inside the 
program: 


~ env NAME=flavio node app.js 
flavio 


/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/Apple/usr/bin 


The env command can also be used to print out all the environment 
variables, if ran with no options: 


env 


it will return a list of the environment variables set, for example: 


HOME=/Users/flavio 
LOGNAME=flavio 


PATH=/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/Apple/usr/bin 
PWD=/Users/flavio 
SHELL=/usr/local/bin/fish 


You can 


also make a variable inaccessible inside the program you run, using 


the -u option, for example this code removes the nome variable from the 


command environment: 


Signy bl 


HOME node app.js 


61. printenv 


A quick 


guide to the printenv command, used to print the values of 


environment variables 


In any shell there are a good number of environment variables, set either by 


the system, or by your own shell scripts and configuration. 


You can 


print them all to the terminal using the printenv command. The 


output will be something like this: 


HOME=/ 


Users/flavio 


LOGNAME=flavio 


PATH=/ 


usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin: /Library/Apple/usr/bin 


PWD=/Users/flavio 


SHELL= 


with a fe 


You can 


value: 


/usr/local/bin/fish 


w more lines, usually. 


append a variable name as a parameter, to only show that variable 


printenv PATH 


fi flay fish /Users/flavio — -fis 
~ printenv PATH 
/usr/Local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/ 


Library/Apple/usr/bin 
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